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INTRODUCTION 

This workbook, is <3.?equel to PLANNING AND IN-SERVICE 

^ - ' ' • ^ * 

EDUCATTON (ED 088-861), AN EVALUATION SYSTEM THAT DOESN'T REQULRE 
HYPER-EXPERTS (ED 092-5'95), EVALUATING TEACHER IN-SERVICE WORKSHOPS 
IN TERMS OF 'LEARNER BENEFITS (ED 106-272), and THIRTEEN ALTERNATIVE 
LEAR'N-ING ENVIRONMENTS THAT CAN BE USED TO EVALUATE THE IMPACT OF 
TEACHER IN-SERVICE WORKSHOPS ON DOCUMENTED' LEARNER BENEFITS 
(ED 107-648) . • . . " • . ; . • '. ^ 

- ' / . 

As such, this workbook gives THREE simple evaluation 
exercises that can be used by workshop directors. to plan, 
implement, and evaluate any given workshop once the major 
workshop objectives have been developed. In cases where the 
objectives are on I y ha I f-f ormed, EVALUATION ITEM #1 will ie 
extremely helpful- ^ 

In case's where the participants have been identified, 
EVALUA.TION ITEM //2 will help the workshop director be certain 
that the OBJECTI VES *AND NEEDS ANALYSIS i s re I eLnt . 

I;i cases v*here the* workshop is already ovcrf EVALUATION 
ITEM #3 wi I I help pinpoint learner benefits where learner refers 
to studclSts taught by teachers particpating at the worj<shop. 
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A suggested list of SELF-ASSESSMENT CRITERIA is given 
in the SE^LF-CORR'ECTING ANSWER KEY 
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..'.•-PO^TTEST 

This posttest is an opportunity for workshop Hiroctors and other 

evaluators to self -evaluate what has been learned as a result of using 

this package on INSEIWICE EDUCATION PROGRAM EVALUATIONo The following 

questions are intended to be activity type evaluation questions rather 

than essay questionSo The individual going through this postteBt is 

requested to think of real life situations which apply the learnings 

acquired in this paclcage© t 

After the questions, self-assessment criteria are given with which 
ft '' , * 

each reader may measure the effectiveness of the answer proposed « 

In those questions which, require the construction of an evaluation 
Instrument 5 the respondent should keep the foilw^/ing suggestions in mind 
* 

lo Keep all evaluation instrimients simpleo 

Use simple ^ language , ■ 

Use simple directions 



2o Identify rating scales clearly s^ that there is no 
doubt in the mind of the evaluator exactly what is 
meant by the different numbers 5 letters^ or categories 
used to rate an itemo' 

3. vary the format and arrangement of the evaluation 
instrmaent: ^ * . 

Employ Some open-ended questions in order to/ 
draw out the evaluators 

Scatter checklists throughout the evaluation 
^ instrumerft, ,^t do not place one checklist 
after another 

Use a variety of report fornta4:s such as 
f boxes p coluimis, circles, cljeclanarks , numbers*,, 

letters, and even multiple choice in order , to 
keep up the interest and attention of, the 
evnluptor * > 



- Don't- forget that the evaluator's^ effort 
expende'a in moving the pencil from one 
fomig)^ to another ia a stimulus which forces 
most/-^eople to think clearly and accuratej-y 

The typical assessment instrument developed by a workshop 
director, whether it be a proa^sessment 'Or a post test, 
is usually given to a small number of individualSp Thus, 
techniques that are helpful and usef^il in /nians testing 
program^ are not always appropriate to extracting maximum 
information froci potential participants in an inservice 
workshop. 



DIRECTIONS: Answer the following questions each on a separate piece 
of. paper, » ■ ^ 

POSTTEST ITEM #1 ^ '"^^ ' 

Describe briefly the nature of a specific workshop in^ 25 words or less 

Develop a. preassessment ijnstrument with which to determine what the 
learners already know, or lean do, or fe(fL about what is proposed in 
the workshop o ] ^ . , 

The purpose of this pre -assessment inslrrumerjit is to determine baseline 
data on prospective participants before the workshop© 



POSTTEST ITEM #2 ^ ^ 

Afjijer' correcting the pretassessment instrument developed fn question 1 
above with the criteria givqn in the answer fkey section,, try to list 
specific examples of hoxv tflie data gathered m the pre-assessment 
* Instrument can have an impact upon the planning, implementation, and 
structuring of the proposed workshopo 

. . * . * ' ^' 

POSTTEST ITEM #3 r K 

ror the same" inservice workshop discussed in .questions 1 and 2 above, 
develop a posttest instrument that pinpoints and evaluates what was 
learned as a result of the workshop. 

Try to zero in on mastery of prespecif;Led objectives and teacher 
. competency. ^ ^ 

The following four levels-of competency may be helpful in the posttest 
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LEVEL I: What is- the competency that the tdacher has 

acquired as a direct result of inservice training? 

LEVEL* II: What is tlie frequency and quality with which 
inservice* trained teachers have exhibited the 
- newly acquired competency ^ in teaching and 

educational influence up on 1 ea mars? 



LEVEL Zll: 



LEVEL IV: 



What barkers nnist be ^emoved in hostilie^ and 
diffcicylt environments in order to make 'sure 
that Uie newsjAr acquired competency is able to 
foster ^eaterylearner success? 

What evidence is available that documents 
trhe linkage between the newly accjuired 
cohipetericy and increased leveLs of learner*, 
success? • * - 



Answering each of iSiese four qitestions satisfies the requirements 
eatth level of analysis© r • 
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; CRITERIA FOR SELF -ASS ESS INC . 

. POSTTEST ITEM #1 " ' _ . , - 

Y . ■ . 

Iti general, the preassessment .instrument should specify lidw the 
worlcshop director measures the bas(3line data of prospective participants ■ 
before the workshopo This baseline data can include four general areas: 

Ao' Previpus exposure * 

Bo Specific personal needs - ^ 

Co Local teaching environments 

D. Pptential multiplier effect ^ 

A. -PREVIOUS EXPOSURE PREASSESS>ffi;NT ITEMS GIVE THE feoSPECTIVE PARTICIPANT 
A CHANCE TO: • . . 

Answer some questions . (KNOWLEDGE EVALUATION), 

Document some skills (imFtJIlMA.NCE EVALUA.TION), and - 

Express values or reactions (ATTITUDE EVALUATION), 

It is possible that this type of pteassessment might suggest that the 
teacher submit a related work sample or some piece of publicity describing 
the teacher's impacto 



SHSCIFIC PERSONAL NEEDS ASSESSMENT ALLOWS THE PROTPECXIVE PARTICIPANT 
TO HAVE A CHANCE TO SUGGEST A SPECIFIC PERSONAL NEED IN LINE WITH 
WORKSHOP OBJECTIVES. \ • 

LOCAL TEACHING ENVIRONMENTS UEFER TO A SPECIFICATION WHERE NECESSARY v 
OF SUCH THINGS AS: • " 



l*catchlng responsibiJj^Uy 
Teaching schedule 
^Length of 'period 
Local constraints 
Individual circumstances 
Available resources * ^ 



This type of preassessmenl: gives the directdr of * the» workshc^ a good 
idea of the actual ^teaching environment in which the prospM^ct^ive td&^cher 
fs situated o . ' 



D. POTENTIAL* MULTIPLIER EFFECT INQUBIES INTO SUCH THINGS AS HW MANY 
* OTHER TEACHERS LOCALLY (IN THE SAjlE SCHOOL OR IN NEARBY SCHOOLS) 
^ARE TEACHING THE SAME THING IN COOPERATING TOGETHER o 



There are pther self-assessment criteria that can be used ip looking 
at the preassfissment iLnstrumont yevolopedo However, the above four ^areas 
have been found to 'be applicable to a x^ide. variety of inservlce workshop 
■programs, " ' ' . 



CRITERIA FOR SELF-ASSESSMENT 
• • . , POSTTEST ■lTEM-#2 

The practical^ worth of apreasseSsment Instrument is in helping make 
decisl/ons that improve the quality of the workshopo The foliating examples 
are related to the four assessment criteria enumerated in the previous 
answero Each of these assessment criteria is herein studied from the 
viewpoint of typical decfBions that could be made as a result" of data ^ 
collected. 

" ' ' ""''^'"••'^ ^ ' -. 

A. PREVIOUS EXPOSURE data may'TieJ!,^ the. fallowing decisions: 

If the prospective participant already knows the content of the 
updating workshop, why have the workshop? ^ ■ 

One reason for the workshop may be to advance, the participants from J 
the baseline facts already possessed to more advanced content© 

Another reason for the workshop may be to advance the participants 
from theory to practice o ^ * *• * . 

In cases where the participant lacks the basic content, certain 
^ timeframes must be changed aroundo Instead of spending one day on the 
introduction^ it anight be necessary to spend two or three days to makd 

sure that a secure foundation ^s developed before advancing to more/ technical 

'J ' 

topicSo * ^ * - ^ 



B/ SPECIFIC PMSOI^At IpnSDS^data may help the workshop director individualize 
the wprkshop for the >pL<jci?lC;^papticipants accepted o 

For example, maybe the teachers already know the basic workshop 
information and can perform the basic workshop skills, but the same teachcjrs 



need help in 
Such dn 
teacher for 
techniques. 



teaching this content to. high schooL students© 
insight would enable the workshop director to choose the right 
-he specific objective of developing appro^iate teaching 



C. LOCAL TEACHING ENVIRONMENTS data can help the workshop director carry on 
a realistic presjentation© . • 



For example, if one of the activities of the workshop is to ^develop a 
curriculum for double periods, this activity would be inappropriate if most 
of the teachers retmrn to a. school system where the only possibility is 
45 minute periods© 

If another activity of the workshop is to develop 15 minute modules, 

teachers returning to 2-^ hour sessions nmjst go hjome with a more practical 

awareness than the reali2!;atiop that 10 fifteen minutq^ uiodules Squal exactly 

J2i hours© The worlcshop must take into account the tact that teachers in 

the typical hour sessions, hctve a number of students who arrive at 

, e - - .' 

different times during tjie normal school day© Some buses arrive ^- hour 

. . ■ ■ ■ ■ ■;■ , . \ , ' 

^fter the. majority have started class© Other bus^s must leave 15 miftutos 
i:p a half hour before the 'majority finish the regulav class period© 

/ 

Axvrareness of these individualizing loclil circumstances can nake the workshop 
more effedtive© 
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Some worthwhile w^/^kshbp actlvifeies presuppose that ipost teachers 
have greenhouses, con^uter terminals , bulldozers , or other exotic equipment 
waiting for use bacf homeo When such resources aren't available locally, 

a workshop that ;^elies too much on.thes^ non-existing t*ools is doomed tro 

/* * ■ . ' 

/ . • 

lack of practical value in the home schcfolo 



D. POTENTIAL MULTIPLIER ^IJFFECT data enables the workshop director to. help 
the largest possible number of teachers and studfeiitSo 

. / ... • .■ ... • ■ 

■ y- ■ ■ ■ • •■■ ■ 

J[f ^^reassessment data te'vjeals, that 5 or 6 teachers work together as a 
team, ^e teacher must decide whether it is beTtter or not to invite more 
than one of these teachers. ' ^ , 

BiPtain* circumstamces will point up the value of bringing two or three 
members of * the same team together in a common wprksKop with other educators. 
Certain other data will point up the value of selecting only one member of 
the tearao 



The ahyyve criteria have pointed out some of ^he decis£\ons that can be 
based upon timely, accurate, !aii4.^je levant preassesg,ment of prospective 
participants in an inservice workshop programo The objective of the 
preassessment is to obtain data upon which decisions can be hasedo In 
general, educational decisions are only as good as the data upon which 
the decision is made© 
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' CRITERIA FOR SELF -ASSESSING / '> 



POSTTEST ITEM #3 \ . 

. ''■ . , • 

The posttest used to evaluate the effectiveness of a specific inservice 
workshop program will vary from program to ^rogramo However, some of the 

following posttest itente are valuables — 

- » " * 

SAMPLE POSTTEST ITEM A: J ^ - 

The activity I found most' beneficial was 
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. \ • - ■ • • . 


SAMPLE POSTTEST ITEM B: 








The activity I f^und least beneficial was 
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Sample posttest items A and B are open-ended and give the participant 
a chance to express a. wide variety of valuable specific informationo 
Th^^J^ceBB of these open-ended items is based nipon the SPECtFICITY and 
RELEVANCE of •the comments extracted from participants . 



SAMPLE P(BTTEST ITEMC: 

' -'^ Checklists, rating scales, or other ^objective measuring devices 
sRould be provided to theasure the mechanics of t;he conference such as 
facilities, personnel, resources, consultants, activity-by-adtivity < 
analysis, logistics, and other data thatHis easily countableo 

' On such checklist devices, room should also be provided :for 
participants and evaluators ' to make comments o 

SAMPLE POSTTEST ITEM D : ^"^ 



Provision should be made to evaluate inevitable hfjmafi elements in 
any'workshop» In other words, ^t tempts should be made to stOR trouble 
spots' that could have been avoided by more careful planningo 

This includes evaluation items that identify and help eliminate: 



1. " Peronality conflicts .car ^clashes >between Staff and participants a 
2^ Activities that are really nothing but slight variations of the 



\ lecture method. 
3 • Presentations that give too much ^technical infoinnation either to 
inundate* participates with facts and figures that oan't be used 
or to show off the qualifications of the^pelebrat^d consultant o 
4. Any activity or program component that does not manifest a 
visible potential valu^ fo:p carryover into the classroom. 

' Sum ■ , 

Obviously, the sample postt^t items given "above are not the only 
ones available o These samples have been given to coyer typical items of 
interest to par-ticipants in inservice workshop programs. ■ - . 



It is obvious that fqr certain subject matter," skills, or values, a 

specific workshop T«$y liave provided either not enough time or too mucsh 

timeo This is du^ to fhe typical tendency in a five day workshop to 

♦ 

<iover a different topic each day whereas in reality three days might be 
required for topic A while a half day' each for the. rest of /the four topics 
would be svi^f ficiento ' <a ' 

An exainple of this is found in the^yjfical curriculum construction 
workshop wherein three days might be necessary tcf fully' iinplement 'operational 
objectives upon which the rest of the curriculum papkage would' dependo 

It must be remembered that th§ objectives of a posttest include more 

' ■ • • . ' , ' 

•% • * 

than gathering applause for a good Job well doneo In the last mentioned, 
example, it is obvious that the task of a posttest is tya pinpoint specific 
errors that can be corrected and remedied in the futureo 

*p ' ' ■ 
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